METHOD FOR DECIDING SEMI S CURVE FOR TONE PROCESS OF A 
DIGITAL COLOR IMAGE 



BACKGROUND OF THE INVENTION 

Field of Invention 

The present invention generally relates to a method for processing tone of a digital 
color image, and more particularly relates to a method for deciding a semi-S curve for 
processing tone of a raster digital color image according to the tone scale (e.g., RGB, 
YC r C b Luv or LCH) of the image. 

Related Art 

In processing digital color image, besides the resolution as a factor directly relating to 
quality of image, the fidelity of color is the most important factor of all. In comparison to 
the control of resolution, the control of color is more complicated. The current color 
systems for defining color mainly include RGB (red, green, blue) primaries, HSB (hue, 
saturation, brightness) or LCH (lightness, chroma, hue) parameters, YC r C b , Lab, Luv, CIE 
XYZ color values, and CMYK (cyan, magenta, yellow, black) primaries. No matter what 
color system is used, human eyes are particularly sensitive to the condition of gray scale. 
The gray scale in RGB system is specified as tone scale, while gray scales in other color 
systems are defined by the brightness parameters. 

According to research, a digital image can be processed of its tone based on an S-shape 
curve, as shown in FIG. 2, in order to improve the contrast of brightness, and saturation of 
colors for an image output device, such as display, printer. In different color systems, the 
meanings of tone scale are different. For example, in the lightness, chroma, hue modes 
(YC r C b§ , LCH, Lab, Luv), CIE XYZ system or CMYK system, the tone scale is the digital 
levels (e.g., 256 levels by 8-bit) from white to black, or digital levels of saturation. In the 
RGB mode, the tone scale is the digital brightness of each primary color (red, green or 
blue), or the brightness of the specific color. In S curve of FIG. 2, the horizontal axis 



represents tone scale of original image, while the vertical axis represents tone scale of 
processed image. In a RGB digital image, for example, the S curve process is to transform 
the tone scales of the red, green and blue primaries of the original into better tone scales 
according to the S curve. The original curve, before the process, is a 45 -degree linear line 
shown in FIG. 2. In order to improve the result of brightness contrast and color saturation 
for an image output device, the tone scale curve has to be changed. A basic and effective 
method is using histogram equalization, which may achieve best result of contrast and 
saturation, but will destroy the relationships between contents of the image and makes the 
image unbalanced. Therefore, the S-shape tone scale process curve is recently used for 
improving the contrast and saturation of image for an image output device, and still mainly 
remaining balance of contents of the image. 

Generally, an output device, such as color monitor, printer or the like, for digital image 
can linearly present the brightness and color saturation of the image, or an S curve can be 
applied for improving the contrast and saturation of the image. But, as shown in FIG. 2, 
different devices, such as a monitor and a printer, have their different characteristic ranges. 
Therefore, they need specific S curves. Prior art for the S curve process is to use a specific 
curve for the specific device. 

But, in practice, the tone scales, for example, R, G, B tone scales for RGB digital 
images, are different from one another for different images. So, a fixed S curve is not 
suitable for processing all images. 

Conventional processes using S curve for transforming tone scale are mainly in three 
kinds. The first kind is to use a fixed S curve without consideration of histogram of the 
image. This manner cannot well adjust every different image. The second kind is to provide 
some different kinds (for example, scenery or people) of images with different S curves. 
But it still cannot accommodate the specific tone scale of each image. The third kind is to 
provide an S curve function, such as sine curve or Gaussian function, which can be 
controlled with an amplitude factor for adjustment of contrast. The third manner can 
provide a better result. But a single S curve may not be suitable for processing whole image 



of unbalanced histogram. Further, human eyes will adapt the vision to the image color 
distribution and decrease the effects of the high occurance color in an image. The affect of 
human vision to the high occurance color is not considered by the prior art processes. 

Therefore, we need a tone scale process method that provides a semi-S curve tone 
5 process and a weighting function for high occurance color to solve the problem. 

SUMMARY OF THE INVENTION 

It is therefore a primary object of the present invention to provide a method for 
deciding a semi-S curve for tone process according to histogram of a digital image. The 
semi-S curve is composed of a shadow portion color enhancement function curve and a 
1 0 light portion color enhancement function curve. 

A further object of the present invention is to provide a method for processing tone 
scale of a digital image in which the histogram of tone scales (for example, of RGB, YC r C b , 
Lab or Luv) is considered for deciding the semi-S curve. The semi-S curve suits the digital 
image and improves the brightness contrast and color saturation for the image output 
15 device. 

To achieve the aforesaid object, a tone process method according to the present 
invention includes steps of analyzing the contents of the image by the histogram; 
generating a semi-S curve according to the histogram analysis; and processing the tone 
scale of the image through the semi-S curve transformation. Therefore, the brightness 
20 contrast and color saturation of the image on the image output device can be improved. 

The method of the present invention also includes a weighting function for high 
occurrence color (larger area of single color in the image). The weighting function 
considers the histogram of the high occurrence color and adjusts the tone scale for a more 
suitable semi-S curve to eliminate the influence of the single color with large area to the 
25 calculation and process of tone scale. 

Further scope of applicability of the present invention will become apparent from the 
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detailed description given hereinafter. However, it should be understood that the detailed 
description and specific examples, while indicating preferred embodiments of the invention, 
are given by way of illustration only, since various changes and modifications within the 
spirit and scope of the invention will become apparent to those skilled in the art from this 
detailed description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will become more fully understood from the detailed description 
given hereinbelow illustration only, and thus are not limitative of the present invention, and 
wherein: 

FIG. 1 is a block diagram of a Semi-S curve colortone processing device; 

FIG. 2 is a diagram showing S curve tone process for image processing and output 
device (printer, display ,etc). 

FIG. 3 is a diagram showing location of a transition point TP of a semi-S curve; 

FIG. 4 is a diagram showing location of a shadow portion color enhancement curve in 
a semi-S curve; 

FIG. 5 is a diagram showing location of a light portion color enhancement curve in a 
semi-S curve; 

FIG. 6 is a diagram showing composition of a semi-S curve by a shadow portion color 
enhancement curve and a light portion color enhancement curve; 

FIGS. 7A ~ 7C are application examples of the present invention showing respectively 
an original image of stone status and images processed through tone scale process with 
transition point parameters TP=2 and TP=3 ; 

FIGS. 8A ~ 8C are further application examples of the present invention showing 
respectively an original image of scenery and images processed through tone scale process 



with transition point parameters TP=2 and TP=3 ; 

FIGS. 9A ~ 9C are further application examples of the present invention showing 
respectively an original image of people and images processed through tone scale process 
with transition point parameters TP=2 and TP=3; 

5 FIGS. 10A ~ IOC are comparative images having same contents but with different 

single-color larger areas and without single-color larger area, and their semi-S curves 
showing the differences among them; and 

FIG. 1 1 is a relationship diagram showing a linear or non-linear relationship between 
the area of single-color larger area and the weighting value (the high occurrence color 
10 weighting value). 

DETAILED DESCRIPTION OF THE INVENTION 

The S curves shown in FIG. 2 for tone scale processes of image output devices have 
been described above. 

The following description for preferred embodiments of the present invention are 
1 5 taking images of RGB mode for examples. 

The method for tone scale process according to the present invention mainly includes 
three steps to enhance a digital color image: converting and sampling image data, deciding 
a semi-S curve for tone process, and transforming the tone scale. 

In the first step of converting and sampling image data, the color image of a document 
20 or object is obtained through an image-capturing device, such as scanner or digital camera. 
In this process, the image data can be converted to various modes (RGB, YC r C b Luv or 
LCH). Then the image data distribution will be analyzed. 

The second step of deciding semi-S curve for tone process is the major technique of 
this invention. It includes steps of: setting the weighting function of high occurrence color 
25 of an image (that is weighting process for the histogram of single color in larger area); 
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composing new histogram of tone scale; setting a transition point for semi-S curve; and 
generating a look up table for tone process. 

The step of analyzing the distribution of image data is to transform the image into a 
histogram of tone scale. The histogram is a bar chart of each tone. For an 8-bit image, 256 
tones (0-255) are presented. In the histogram, horizontal axis shows the tone value (0~ 
255), while the vertical axis shows the amount of pixels for each tone in the image. 

The principle of this invention is to find out the tone scales (e.g., RGB, YC r C b , Luv or 
LCH), to decide a semi-S curve for tone process according to the histogram, and to process 
tone scale based on the semi-S curve in order to improve the contrast and saturation result 
of image output through the output device. The present invention relates to tone process of 
image and is capable of improving output quality of image for better contrast and color 
saturation. In an RGB image, the color is created with red, green and blue lights as three 
additive primaries. It becomes dark when no light added. Each primary light gives color. 
More lights give higher brightness, and the utmost is white. In other words, higher tone 
scale value gives higher brightness. According to the effect of semi-S curve for tone 
process, we will enhance the contrast at both shadow color portion and light color portion 
of the image. That means, to process the tone scales with the semi-S curve to decrease the 
tone values of the original image at the shadow color portion, and increase the tone values 
of the original image at the light color portion. Meanwhile, the relative level of the RGB 
image will be increased. Therefore, the contrast of brightness and saturation of color of an 
image output can be improved. 

To achieve the aforesaid objects, the semi-S curve is composed of shadow-color 
enhancement curve O-TP and a light-color enhancement curve TP-E linked at a transition 
point TP. The semi-S curve crosses the original curve (a straight line) at the point TP. The 
shadow-color enhancement curve O-TP lies under the original curve and has maximum 
offset point P,. The vertical distance Dj from the offset point P, to the original curve is 
called the maximum downward offset. The light-color enhancement curve TP-E lies 
beyond the original curve and has maximum offset point P 2 . The vertical distance D 2 from 



the offset point P 2 to the original curve is called the maximum upward offset. Therefore, 
starting from the tone scale value N of the transition point TP, the semi-S curve process 
enhances shadow colors to the pixels that have tone scale values smaller than N; and 
enhances light colors to the pixels that have tone scale values larger than N. 

The following description is an example of processing an RGB image of 8-bit color 
(with tone scale values 0-255) by analyzing the histogram of tone scale of the image and 
deciding a semi-S curve for the process. The processing steps are: 

a) using the analyzed data distribution of the image to decide a transition point TP for the 
semi-S curve; 

b) deciding the shadow-color enhancement curve O-TP of the semi-S curve locating 
before the transition point TP; 

c) deciding the light-color enhancement curve TP-E of the semi-S curve locating after the 
transition point TP. 

In step a), the RGB histogram of tone scale is first made, in which the samples 
probability F n (n=0~255) of RGB pixel samples locating in each tone scale (0-255) are 
summarized. Then, the samples of RGB pixel samples from the darkest level (tone scale 0) 
are added till the sum of samples probability £ F n (n=0~n) reaches a value of 1/P, called 
"transition point parameter", determined by the user. P is a positive number less than one. 
Based on the parameter P, the position of transition point TP, as shown in FIG. 3, for 
generating the semi-S curve can be determined accordingly. 

The aforesaid samples probability F n is the sum of samples probability of RGB pixels 
locating in a certain tone scale position (0-255). For example, if the image has 400 
thousand pixel samples totally, and the R, G, B color pixel samples in tone scale 64 are 300, 
400 and 570 respectively, then the samples probability F 64 is calculated as follows: 

F 64 = (300/400000)+(400/400000)+(570/400000)=0.003 1 75 



In other words, the samples probability F n is the ratio of pixel sampling numbers in 
that specific tone scale value n to the total pixel samples of an image. 

In step b), the present invention takes summation of the samples probability F n , starting 
from F 0 (samples probability of tone-scale 0) to F N/2 (samples probability of tone-scale 
5 N/2) where N is the tone scale position of the transition point TP. For example, if N=100, 
then N/2 = 50. If the sum of samples probability F 0 to F N/2 equals F l5 i.e., £ F n 
(n=0~(N/2))=F 1 , then the maximum downward offset D, of a maximum downward offset 
point P, can be calculate as follows: 

D,= C, (2PF r l) when 2PF r l<0, and 
10 D,=0 when2PF,-l>0 

Then, we can find out the function and line of the shadow portion color enhancement 

curve O-TP (as shown in FIG. 4) according to the origin (0, 0), the transition point TP (N, 

N) and the maximum downward offset value Dj. In the above formula, C, is a shadow 

portion color enhancement constant (positive number), For example, Cj=N in the 

15 embodiments of FIGS. 7 A ~ 10C. And, 2PF r l is a parameter for sufficiency of shadow 

portion color. 2PF r l>0 means shadow portion color is sufficient without the need of 

further enhancement. 

In step c), the present invention takes summation of the samples probability F n , starting 
from F (N+ . 255)/2 (samples probability of tone-scale (N+255)/2) to F 255 (samples probability of 
20 tone-scale 255) where N is the tone scale of the transition point TP. If the sum of samples 
probability F (N+255)/2 to F 255 equals F 2 , i.e., £ F n (n=(N+255)/2~255)=F 2 , then the maximum 
upward offset D 2 of a maximum upward offset point P 2 can be calculate as follows: 

D 7 = C 7 [(1-2PF 2 )/(P-1)] when (1-2PF, )/(P-l) >0, and 
D 2 =0 when(l-2PF 2 )/(P-l)<0 

25 In which, C 2 is a light portion color enhancement constant (positive number), For 

example, C 2 =255-N in the embodiments of FIGS. 7A ~ IOC. And, (1-2PF 2 )/(P-l) is a 

parameter for sufficiency of light portion color. (1-2PF, )/(P-l)<0 means light portion color 

is sufficient without the need of further enhancement. 
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In the same way, we can find out the function and line of the light portion color 
enhancement curve TP-E (as shown in FIG. 5) according to the end point (255, 255), the 
transition point TP (N, N) and the maximum upward offset value D 2 . 

As shown in FIG. 6, we can compose the shadow portion color enhancement curve O- 
5 TP and the light portion color enhancement curve TP-E into a semi-S curve for tone scale 
process. In FIG. 7A, an original image is shown. A semi-S curve is determined by the 
aforesaid steps and used to process the image. When the P value is set to 2 and 3 
respectively, the processed images are shown in FIGS. 7B and 7C where the brightness 
contrast and the color saturation are obviously improved. The same processes are applied to 
10 images of people as shown in FIGS. 8A-8C, and images of scene as shown in FIGS. 
9A-9C. Here we can see that suitable adjustments can be taken for desired results by the 
semi-S curve tone processes. 

But, in practice, there may be some single-color larger areas locating in the image, also 
called as high occurrence color, that will influence the shape of the semi-S curve. For 

15 example, three images having mainly same contents are shown in FIGS. 10A-10C. The 
image of FIG. 10A has a larger white patch area in the boundary. The image of FIG. 10B 
has a larger black patch area in the boundary. And, no larger single color area is located in 
the image of FIG. 10C. According to principle of this invention, the semi-S curves decided 
from the three images should be the same, at least extreme similar. But, actually they much 

20 differ from each other as shown in the figures due to the existence and different colors of 
the larger single color areas. On the contrary, human eyes can easily eliminate this kind of 
difference occurring from high occurrence color. 

In order to solve the aforesaid problem, we can add a weighting procedure before the 
step a) for compensating the high occurrence color effect, and rearrange the histogram of 
25 tone scale, so as to decrease the influence of the single-color larger area to the calculation 
and process of tone scale. 

The step of the weighting procedure is to analyze the histogram, find out the larger area 
of single color (the area with the same or similar tone scale), and multiply the area LR with 
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a weighting value F(W f ). The weighting value F(W f ) can be a linear or non-linear 
decreasing function curve relative to the area as shown in FIG. 1 1, in which the horizontal 
axis is the area of single-color, while the vertical axis is the weighting value. By the 
weighting process, the samples probability of tone scale can be recalculated, and a 
5 histogram considering the weighting will be changed. 

First, we determine a threshold LR, h for judgement of larger area of high occurrence 
color. The unit for the area can be samples number of each tone scale (0-255) or the 
samples probability F n of each tone scale (n=0~255). Those area smaller than the threshold 
LR, h will get a weighting value "1". That area larger than the threshold LR, h will get a 
10 weighting value between 0 to 1. That is, the weighting value for the largest area is 0. The 
rest are set with values between 0 and 1 according to the size of areas in a relationship of 
linear or non-linear decreasing. A non-linear relationship can be set by the user. A linear 
mapping can be determined as follows. 

Linear F(W f ): 

15 F(W f )= 1 when LR < LR, h , and 

F(W f )= 1 - (LR- LR,,, )/ (1- LR, h ) when LR > LR, h 

There may be a large number of pixels with same tone scale in an image, but different 
tone scale pixels may evenly located everywhere in the image, and the areas of different 
tone scales may not differ too much from each other. Supposing the pixels for each tone 
20 scale 0-255 are the same and each occupies 1/256 of the total area, then, there is no need 
for the weighting process of larger area. Therefore, the threshold LR th should be larger than 
1/256, and practically, be set to 1/20, 1/10 or even larger, so as to show the tone process 
result of decreasing influence of high occurrence color due to larger single-color area. 

The method of the present invention can be accomplished and embodied through 
25 software incorporated in an image -processing program, as shown in FIG. 1, or incorporated 
directly into firmware of a digital image output device. 

The tone scale process according to the present invention can accommodate to the tone 
scale histogram of the specific image, and find out a suitable semi-S curve for the tone 
scale process. In comparison to conventional process methods, the present invention can 



10 



obtain better results of contrast of brightness and saturation of color for every different 
image. 

For those high occurrence colors existing in the digital image, the present invention 
provides a weighting process to rearrange and analysis the histogram of the image and to 
eliminate the influence of high occurrence color to the tone scale process. 

Therefore, the present invention provides a tone scale process method that decides a 
suitable semi-S curve for improving the brightness contrast and color saturation for a digital 
image. The semi-S curve accommodates to the contents of the image for better image 
quality results. A weighting process is also applicable to eliminate the influence of high 
occurrence color to the tone scale process. So that, the image output devices can generate 
images with good quality. 

Though the aforesaid embodiments are based on an RGB image, the other color 
systems, such sRGB (standard RGB); LCH, CIE Lab, Munsell coordinates; YC r C b and Luv, 
are also applicable. 

The invention being thus described, it will be obvious that the same may be varied in 
many ways. Such variations are not to be regarded as a departure from the spirit and scope 
of the invention, and all such modifications as would be obvious to one skilled in the art are 
intended to be included within the scope of the following claims. 
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